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China  Lake,  California,  between  February  and  October  1976.  The  task  is  part  of  a Naval  Air  Systems 
Command  program  on  Human  Factors  Engineering.  It  is  supported  by  AirTask  No. 
A03A-3400/00813/7F55-525-000  under  the  direction  of  CDR  Paul  Chatelier  (AIR-340F). 

This  report  has  been  reviewed  for  technical  accuracy  by  R.  A.  Erickson. 

Released  by  Under  authority  of 

M.M.  ROGERS.  Head  G.  L HOLLINGSWORTH 

Systems  Development  Department  Technical  Director 

17  March  1977 


NWC  Technical  Publication  5952 


Published  by Technical  Information  Department 

Manuscript  2362/MS  B06M 

Collation  Cover,  10  leaves 

First  Printing 195  unnumbered  copies 


• i . V «.i 


SECURITY  CLASSIFICATION  OF  THIS  PAGE  flWien  Dmtm  EnlsredJ  


READ  INSTRUCTIONS 
BEFORE  COMPLETING  FORM 


12.  GOVT  ACCESSION  NO.i  3.  RECIPIENT'S  CATALOG  NUMBER 


REPORT  DOCUMENTATION  PAGE 


a uvvbncu  / 

Cockpit  instrumentation  study  / !Lrf£ft 

F^hjdto/ — Drtahmr  v ' 


different  from  Controlling  Office)  | 15.  SECURITY  CLASS,  (of  thla  report) 

UNCLASSIFIED 


1 5a.  DECLASSIFICATION.  DOWNGRADING 
SCHEDULE 


16.  DISTRIBUTION  STATEMENT  (of  thla  Report) 

Approved  for  public  release;  distribution  unlimited. 


17.  DISTRIBUTION  STATEMENT  (of  the  ebetrect  entered  In  Block  20,  It  different  from  Report) 


19-  KEY  WORDS  (Continue  on  reveree  elde  If  neceeaery  end  Identity  by  block  number) 


Color  coding  Malfunction  indications 

Color  TV  Monochrome 

Black-and-white  TV  Ambient  Illumination 

Target  detection 


20  ABSTRACT  (Continue  on  reveree  aide  tf  neceeeeey  end  Identity  by  block  number) 

See  back  of  form. 


DD  , j?n  7,  1473  *°'TION  OF  1 NOV  « IS  OBSOLETE  UNCLASSIFIED 

S/N  0102-014-  6601  LAg?1* 

SECURITY  CLASSIFICATION  of  This  faOE  Knte 


H|  T Y CLASSIFICA  T ION  OF  THIS  P AGE'Hhsn  Data  Entered, 


\.(ll)  Experiments  With  Color  Coding  on  Tele  i.uon,  by  Dan  W.  Wagner. 
ChinaS^ake.  Calif.,  Naval  Weapons  Center.  January  1977.  18  pp.  (NWC  TP 
5952.  privation  UNCLASSIFIED.) 

(U)  Three  experiments  were  conducted  to  investigate  the  effectiveness 
ot  color  coding  in  a potential  cockpit  application.  The  experiments  measured 
the  subjects'  ability  to  monitor  random  malfunction  indications,  shown  in 
either  color-coded,  single  color,  or  black-and-white  conditions  on  simulated 
engine  management  displays.  The  subjects  were  simultaneously  engaged  in  a 
dynamic  target  detection  task  on  an  adjacent  display  during  the  monitoring 
task.  Ambient  illumination  color  and  subject  experience  were  additional 
variables. 

(U)  The  results  show  that  response  time  on  the  target  detection  task 
was  taster  when  the  engine  display  was  color-coded  than  when  it  was 
black-and-white.  Time  to  report  malfunctions  was  slower  with  red  or  green 
monochrome  displays  than  with  the  other  colors.  The  response  time  in 
reporting  malfunctions  on  the  black-and-white  display  was  not  affected  by  the 
choice  of  color  on  the  adjacent  display.  Finally,  performance  on  target 
detection  and  malfunction  reporting  was  not  affected  bv  ambient  illumination 
or  the  experience  of  the  subjects. 


StCUNlTY  CLASSIFICATION  OF  THIS  PAGEfm>.n  Dal*  Entered: 


NWC  TP  5952 


CONTENTS 

Introduction 

Background 

Overview 

Methodology  

Apparatus  

Experimental  Design  

Subjects 

Procedure  

Analysis 

Results  and  Discussion 

Display  Colors  

Display  Illumination 

Observer  Experience  

Summary 

Appendixes: 

A.  Subjects’  Recorded  Instruction 

B.  Errors  


INTRODUCTION 


Aircraft  cockpits  of  the  future  very  likely  will  contain  visual  displays  capable  of  conveying  the 
information  from  the  many  existing  gauges,  dials,  and  discrete  indicators  onto,  perhaps,  two,  three,  or 
four  programmable  multifunction  displays.  This  integrated  approach  to  cockpit  instrumentation  is  being 
pursued  by  the  Navy  with  its  Advanced  Integrated  Display  System  (AIDS)  (see  Figure  I).  while  the  Air 
Force  is  working  on  a similar  program  called  the  Digital  Avionics  Instrumentation  System.  The  Army  is 
developing  fiberoptic  displays  and  solid-state  electronics  to  replace  conventional  helicopter  engine  dials 
and  gauges. 


It  is  conceivable  that  this  work  may  eventually  lead  to  a standardized  cockpit  control  and  display 
arrangement  common  across  the  military  services  and  even  commercial  airlines.  For  example,  the 
right-hand  instrument,  such  as  a cathode  ray  tube  (CRT'  or  liquid  crystal  display,  might  present 
preflight  and  take-off  checklists  as  well  as  warning  and  caution  advisories  together  with  suggested 
corrective  actions,  thus  eliminating  most  of  the  warning  and  advisory  lights  scattered  throughout  the 
cockpits  of  sophisticated  aircraft.  The  goal  of  the  effort  is  to  increase  the  efficiency  of  the  pilot  and 
aircraft  by  eliminating  errors  of  indicator  interpretation  and  reducing  the  response  times  for  'he  various 
contingencies. 


FIGURF  I Advanced  Display  Concept 
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One  of  many  questions  to  be  answered  in  developing  the  integrated  display  concept  is.  “Should 
the  displays  be  capable  of  presenting  the  information  in  conventional  black-and-white  (B&W),  a single 
color  (monochrome),  several  colors,  or  perhaps  some  combination  of  the  above?”  The  state-of-the-art  for 
monochromatic  and  B&W  displays  is  well  advanced— at  least,  for  CRT  representations— and  would  require 
only  moderate  developmental  effort.  Color  appears  to  offer  an  attractive  alternative.  Although  the 
technology  is  less  advanced,  it  provides  another  dimension-color-to  the  form  and  luminance 
presentations  of  the  other  displays.  It  is  to  this  added  dimension  of  color  and  its  potential  uses  in 
aircraft  cockpits  that  the  remainder  of  this  report  is  addressed. 


BACKGROUND 

Several  recent  literature  reviews  have  been  concerned  with  the  use  of  color  in  visual  displays.' 
Color  has  been  studied  both  as  a method  of  presenting  realistic  or  natural  imagery  and  as  a means  of 
coding  information.  Only  a few  studies  involving  natural  color  representations  on  displays  are  reported. 
Studies  using  color  compared  to  B&W  film  tend  to  show  that  color  reduces  response  time  and  errors 
while  increasing  the  number  of  target  detections.4  ,s '*  However,  experiments  designed  to  simulate 
air-to-ground  target  detection  and  recognition  tasks  with  color  compared  to  B&W  television  have  failed 
to  show  that  color  consistently  improves  performance.7’8’9 


1 Naval  Weapons  Center.  Color  Coding  An  Annotated  Bibliography,  bv  Dan  W.  Wagner.  China  Lake,  Calif  NW( 
March  1977.  (NWC  TP  5922,  publication  UNCLASSIFIED  ) 

2 Army  Human  Engineering  Laboratory  Color  Coding  A Review  of  the  Literature,  by  Thomas  C.  Cook 
Aberdeen  Proving  Ground.  Md..  HI  L,  November  1974.  (Tech  Note  9-74.  publication  UNCLASSIFIED.) 

R.  F.  ( hrist  jnd  W.  H.  Teichncr.  Color  Research  for  Visual  Displays.  New  Mexioo  State  University.  Las  Cru,  es 
N.M..  July  1973.  (JANAIR  Report  73073.  publication  UNCLASSIFIED.) 

4 Army  Behavior  and  Systems  Research  Laboratory.  Intelligence  Information  From  Total  Optical  Color  linage 
by  T F Jet  trey  ami  I . J.  Beck.  Arlington.  V.i  . ABSRL.  November  1972.  (Research  Memorandum  72-4  publication 
UNCLASSIFIED.) 

' Honeywell.  Inc.  Target  Recognition  Performance  With  Chromatic  and  Achromatic  Displays,  by  J.  I.  Maikoff 
Minneapolis.  Minn..  III.  1972  (SRM-14S,  publication  UNCI  \SSIFIED.) 

8 A.  H.  I ickncr  and  E.  C Poulton.  "Watching  for  People  and  Actions,"  Ergonomics,  Vol.  I 8 ( 1975 1,  pp.  35  51. 

Naval  Weapons  Center.  Target  Detection  With  Color  Versus  Black  and  White  Television,  by  Dan  W.  Wagner 
China  Lake.  Calit..  NWC.  April  1975  (N\\<  TP  5 731,  public  it  on  UNCLASSIFIED.) 

8 Martin -Marietta  Corporation.  Target  Acquisition  Studies  (2)  Target  Acquisition  Performance  Color  lc 
Monochrome  T I Displays,  by  I I)  lowlcr  and  D B Ion  s Baltimore.  Md..  January  1972.  (OR  11  p 7*8  publico  on 
UNCLASSIFIED  ) 

4 Njvjl  Weapons  ( enter.  Target  Acquisition  With  Color  I s.  Black  and  White  Television,  by  Dai,  W Wagner.  « tna 
lake.  Call!  . NW(  October  1975.  (NWC  TP  5800.  publication  UNCLASSIFIED.) 
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Hie  literature  on  color-coding  displays  is  considerable  more  abundant.  It  generally  indicates  that, 
as  a coding  method,  color  is  helpful  for  search-a. .-.-locate  tasks,  but  numbers  are  more  effective  for 
identification  tasks.  For  example,  Christner  and  Rayl * * * * * * * * 10  investigated  colors,  numbers,  and  shape-target 
codes  in  combination  with  a variety  of  backgrounds  for  tasks  involving  locating,  counting,  identifying, 
comparing,  and  verifying.  They  found  that  color  provided  the  best  performance  for  locate-and-count 
tasks,  while  numbers  were  best  for  identification  tasks,  and  no  significant  difference  was  found  among 
the  three  coding  methods  for  comparison  and  verification  tasks.  Hitt1 1 studied  these  tasks  also,  but 
included  the  two  additional  coding  methods  of  letters  and  configurations  (i.e.,  the  placement  of  small 
squares  within  larger  squares).  He  found  that  numbers  and  colors  were  the  superior  coding  methods, 
with  no  significant  difference  between  the  two  except  for  the  symbol  identification  task,  for  which 
numbers  were  better. 

If  color  can  be  used  to  effectively  locate  or  call  attention  to  objects  on  a display,  as  the  literature 
suggests,  then  what  display  colors  will  provide  the  best  performance?  A number  of  studies  have 
investigated  the  question,  with  the  result  being  that  from  4 to  60  colors  can  be  encoded,  depending 
upon  training  and  practice  time,  performance  measure,  type  of  display,  and  the  task.'  2,1  3,1 4,1 5-1 6 
Usually,  however,  four  to  six  colors  are  considered  practical  with  red,  green,  yellow,  blue,  and  white 
frequently  mentioned  as  the  most  likely  candidates.1  7,1  8 ■*  °-20 


l11  (.  A.  Christner  and  H,  W Ray.  "An  Evaluation  of  the  Effect  of  Selected  Combinations  of  Target  and 
Background  Coding  on  Map-Reading  Performance,"  Exp  V,  Hum  Factors.  Vol.  3 (1961 1,  pp.  1 31  146. 

*1  W.  D.  Hitt.  “An  Evaluation  of  F:ive  Different  Abstract  Coding  Methods."  Exp  IV.  Hum  Factor . \ol  1 
(1961).  pp  120  130. 

1 - Wright  Air  Development  Division.  Absolute  Identification  of  Color  tor  Targets  Presented  Against  U7  ! and 
Colored  Backgrounds,  by  H.  P.  Bishop  and  M.  N.  Crook.  Wright-Patterson  Air  1 oree  Base.  Ohio.  V,  ADD.  March  1961 
iTethincal  Report  60-61 1.  publication  l N(  I \SSIP1ED.) 

' \.  ('ha pants  and  R.  M.  Halsey  "Absolute  Judgment-  of  Spectrum  Colors,"  J.  Psvch..  Vol  41  e i 9561. 
pp.  99  103. 

14  Wright  Air  Development  Center.  The  Csc  of  Color  in  Coding  Displays,  by  D.  W Conover  and  .1  Kraft 
Wright-Patterson  Air  force  Base. Ohio.  W ADC,  1958.  iWADC  TR-55-471.  publication  UNCLASSI!  11  D I 

1 ^ Bunkcr-Raino  Corporation,  (luidc  to  Human  Engineering  Design  for  Visual  Displays.  In  D Meistv  and 
D.  W.  Sullivan.  Canoga  Park,  Calif..  BRC.  August  1969.  (AD  693  237.  publication  UNCLASSIFIED) 

1 ^ S.  L.  Smith  and  D.  W.  Thomas.  “Color  Versus  Shape  Coding  in  Information  Displays."  J.  Appl.  Psvch..  Vol  48 
(1964),  pp.  137  146. 

federal  Aviation  Administration.  Department  of  Transportation.  Color  Display  Evaluation  for  Air  Ira  I in 
Control,  by  D.  W.  Connolly.  G.  Spanicr.  and  F. Champion.  Washington,  D.C.,  fAA.  Mas  1975.  (Repon  No 
FAA-R D-75-39,  publication  UNCLASSIFIED  ) 

* 8 National  Aeronautics  and  Spase  Administration.  Response  Time  to  Colored  Stimuli  in  the  l ull  I tsual  he  , . 
R.F.  Haines,  L.  Markham  Dawson,  I eryc  Galvan,  and  Lome  M.  Reid.  Washington.  DC.  NASV.  1974  i\AS\  IN 
D-7927,  publication  LNCLASSII  II  D.) 

'9  Air  force  Systems  Command,  Rome  Air  Development  ( enter.  Research  and  le  nnology  Division,  i : 
Specification  for  Additive  Color  (.roup  Displays,  by  I I Ri/y  Griffin  Air  I oree  Base.  N V RAIN  August  |o*« 
IRAIX -IR-65-278,  AD  b2l  068.  publication  UNCL  ASS1I  I1  IV  i 

R Tyte,  J.  Whart,  and  B Ill's  "Visual  Response  Times  in  High  Ambient  Illumination."  Sir  nr  'or 
Information  Display  Digest.  1975.  pp.  98  99. 
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A further  consideration,  if  color  displays  are  to  be  used  in  cockpits,  is  the  color  of  the 
illumination.  Newer  aircraft  have  used  red  or  white  lighting  for  cockpit  illumination  during  night 
operations.  Red  lighting  has  been  used  since  WW  II,  since  it  was  known  that  night  (scotopic)  vision  was 
better  maintained  by  red  light  than  typical  white  light.  While  this  fact  is  well  established,  the  operational 
significance  ol  it  is  questionable,  because  the  values  were  established  at  or  near  threshold  levels  that  have 
little  bearing  on  applied  situations.  Johnson  and  Poston21  recently  studied  the  issue  in  relation  to 
helicopter  pilot  visual  acuity  and  peripheral  vision  performance  under  red  or  white  illumination.  They 
found  that  cockpit  lighting  color  was  not  a significant  factor  for  legibility  levels  or  peripheral  vision 
performance.  The  interest  for  the  present  studies  is  to  determine  whether  either  color  affects 
performance  with  color  displays. 

One  other  v triable  of  interest  for  studies  involving  basic  airborne  target  acquisition  and 
monitoring  tasks  is  subject  experience.  Pilots  or  other  aircrew  members  are  the  preferred  subjects  for 
these  studies,  since  they  are  the  eventual  user  population.  However,  since  most  studies  are  parametric 
and  do  not  require  the  sophisticated  level  of  training  achieved  by  pilots,  and  since  relatively  few  pilots 
are  available  in  comparison  with  the  engineers  and  other  professionals  accessible  to  the  groups  usually 
doing  these  investigations,  it  would  be  worthwhile  to  determine  how  well  several  of  these  groups 
compare  with  the  pilot  group. 


OVERVIEW 


a* 


Three  laboratory  experiments  were  designed  to  investigate  the  effectiveness  of  color  coding  in  a 
potential  cockpit  application.  Experiment  I measured  the  subjects'  ability  to  monitor  random 
malfunction  indications  on  one  simulated  engine  management  display  while  engaged  in  a target  detection 
task  on  an  adjacent  display.  Response  time  and  error  scores  were  used  to  compare  performance  between 
color-coded  and  B&W  presentations  of  10  engine  malfunctions.  Experiment  II  was  conducted  to 
determine  whether  fewer  malfunctions  per-unit-of-time  would  increase  the  relative  effectiveness  of  color 
coding.  The  second  experiment  was  similar  to  the  first  except  that  only  3,  instead  of  10,  malfunctions 
were  presented  over  the  same  time  period. 

The  relative  effectiveness  of  a B&W,  single-color,  or  two-color  coded  display  was  investigated  in 
Experiment  III.  A second  engine  management  display,  shown  in  black  and  white,  was  added  to  the 
equipment  used  in  the  first  and  second  experiments.  This  display  provided  the  means  of  both  increasing 
the  monitoring  task  workload  and  evaluating  the  simultaneous  use  of  color  and  B&W  displays. 
Additionally,  the  display  conditions  were  seen  under  red  or  white  illumination  to  determine  if  display- 
color  interacted  with  ambient  illumination  color. 


•H  Army  Human  1 ngineering  Laboratory.  A Comparison  of  Red  and  While  Cockpit  l.i/ihling  Lnuer 
Qiwsi-Oprrolional  Conditions,  by  Neil  A.  Johnson  anil  Alan  M Poston.  Aberdeen,  Mii..  IIF.L.  January  1976.  (TM  6-76. 
publication  UNO  ASSH  II  1’  i 
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METHODCM  OGY 


APPARATUS 


The  equipment  used  for  these  experiments  is  described  below.  Figure  2 provides  a sketch  of  the 
apparatus  as  arranged  for  the  experiment. 


Recording  Equipment 


An  Ampex  5800  color/B&W  video  tape  recorder  and  a Cohu  1230D  color  television  camera  were 
used  to  record  terrain  model  sceneiy  containing  scale  model  targets  and  engine  management  displays. 
Full  descriptions  of  the  terrain  model,  targets,  and  television  camera  are  contained  elsewhere.9 

Electrical  contacts  were  .r.tached  to  the  back  of  the  engine  display  in  such  a manner  that,  when  a 
malfunction  occurred,  a circuit  would  close,  initiating  a 1600-Hz  tone  from  an  audio  generator.  This 
audio  was  recorded  on  the  tape  along  with  the  video.  A tone  was  also  recorded  on  the  target  scenery 
tape  to  provide  a determination  of  when  targets  were  within  view  on  the  TV  monitor. 

Playback  Equipment 

Two  video  playback  units  were  connected  to  two  TV  monitors  for  the  first  two  experiments.  An 
Ampex  VPR  5800  color/B&W  video  recorder  transmitted  engine  management  information  to  a Conrac 
5022C12  color/B&W  TV  monitor,  while  an  Ampex  VR  6000  transmitted  the  terrain  model  imagery  to  a 
Conrac  RND-9  B&W  IV  monitor. 

For  the  third  experiment,  three  video  playback  units  were  connected  to  three  TV  monitors.  The 
Ampex  5800  transmitted  engine  management  information  to  the  color  TV  monitor,  while  an  Ampex 
VR  660  transmitted  B&W  engine  management  information  to  a Conrac  RN'D-9  TV  monitor.  The 
Ampex  6000  transmitted  the  target-scenery  information  to  another  RND-9  TV  monitor.  The  video  tapes 
played  on  the  B&W  recorders  and  monitors  were  duplicated  from  the  original  color  tapes. 

The  recorder/playback  units  were  adjusted  to  original  specifications  by  Ampex  technicians.  The 
TV  monitors  were  adjusted  for  matching  geometry  and  linearity.  The  larger  color  monitor  raster  was 
reduced  in  size  to  provide  the  same  viewing  area  as  the  smaller  B&W  monitors. 


Recorded  Imagery 

The  recorded  scenery  moved  from  the  top  to  the  bottom  of  the  display  simulating  level  flight 
over  the  terrain  which  resembled  moderately  foliated  foothills.  The  tank  and  truck  targets  were  located 
along  the  test  track  at  irregular  intervals.  They  were  in  view  on  the  subject’s  monitor  for  6.6  seconds 
and  subtended  an  angle  of  20  minutes  of  arc  to  him.  as  calculated  from  the  maximum  viewing  distance 
of  30  inches  (762  mm). 

The  recorded  engine  management  display  consisted  of  five  engine-performance  parameters  shown 
in  one  linearly  formated  display  (see  Figure  2).  The  markings  were  white  on  a black  background,  while 
the  indicator  arrows  were  light  green  when  in-tolerance,  changing  to  red  when  out-ot-tolerance 
(malfunction).  A white  line  located  under  a portion  of  each  engine  parameter  was  used  to  indicate  the 
in-tolerancc  range.  The  marking  colors  on  the  color  engine  display  were  varied  by  controlling  the  red 
blue,  and  green  beams  of  the  color  monitor  (c.g .,  switching  off  the  blue  beam  provided  yellow  markings 
with  a red  arrow  when  an  out-of-tolerance  condition  occurred).  By  additionally  switching  from  t*'e  color 
to  a monochrome  signal,  monochromatic  yellow  markings  were  provided  (i.e..  die  arrow  did  not  change 
from  yellow  to  red,  but  stayed  yellow  when  out-of-tolerance).  The  marking  md  arrow  color 
combinations  and  chromaticity  coordinates  are  provided  in  Tables  1 and  2.  The  luminances  <•'  the 
markings  were  adjusted  to  5 llL  (17.1  cd/m2)  (±1)  for  all  conditions.  The  underlines  and  m ows 
subtended  visual  angles,  respectively,  of  4.5x35.7  and  11.2x15.7  minutes  of  arc  at  the  maximum 
viewing  distance. 


TABLE  1 . Engine  ,v  ,piay  Colors. 


Experiment 

Markings 

Arrows 

In-tolerance 

Out-of-tolerance 

I and  II 

White 

White 

White 

White 

Green 

Red 

HI 

Red 

Red 

Red 

Green 

Green 

Green 

Blue 

Blue 

Blue 

Yellow 

Yellow 

Yellow 

White 

White 

White 

White 

Green 

Red 

Yellow 

Yellow 

Red 

TABLE  2.  Engine  Display  Color  Specifications. 


Color 

Chromatieity 

Wavelength, 

nm 

Saturation. 

% 

X 

y 

Red 

0.656 

0.322 

630 

94 

Green 

0.323 

0.594 

550 

77 

Blue 

0.146 

0.045 

450 

97 

Yellow 

0.434 

0.505 

572 

82 

White 

0.318 

0.290 

Response  Buttons 


When  a subject  saw  a target,  he  pushed  a hand-held  response  button  When  he  saw  a malfunction 
indicated  on  one  of  the  engine  management  displays,  he  first  pushed  one  of  two  buttons  to  indicate 
whether  the  malfunction  was  occurring  on  the  right  or  left  display  (these  two  buttons  wire  not  used  in 
the  initial  two  studies)  and  then  pushed  one  of  live  buttons  to  indicate  which  one  of  five  parameters 
was  out  of  tolerance.  These  buttons  were  mounted  on  a panel  in  front  of  the  displays.  All  buttons  were 
wired  to  a Honeywell  906C  12-Channel  Visicorder.  The  printout  from  this  recorder  provided  a'l  the 
required  response  time  and  accuracy  data  for  analysis. 

Subject  Area  Lighting 


The  subjects’  monitors  were  viewed  under  conditions  of  red  and  white  illumination  for  the  third 
experiment.  The  light  incident  on  the  color  monitor  was  measured  with  a Techtronix  .110-6503 
illuminance  probe.  The  lighting  for  the  experiment  was  as  follows: 


0.4  ftc  (4.3  lux) 
0.4  ftc  (4.3  lux) 


Red 

White 


110V  G.E.  50W.  115V 
OlV  W.ll.  I5W.  120V 
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General  Equipment 


Additional  equipment  used  to  calibrate  and  monitor  the  experimental  apparatus  included 
Gamma  Scientific  1C  2000K  telepholometer  to  adjust  the  luminance  and  measure  the  chromaticity  u 
the  subjects’  monitors;  a llellige  IRT  Mark  5 color  comparator  to  color-balance  the  color  display  a 
6500k:  Visual  Information  Institute  216  test  pattern  and  306  synchronization  generators  to  com  par 
and  adjust  the  linearity  and  geometry  of  the  subjects’  monitors:  and  a circuit  designed  and  built  at  NW( 
to  convert  the  audio  signals  to  electronic  signals  for  display  on  the  Visicorder. 


EXPERIMENTAL  DESIGN 

Three  studies  were  designed  to  compare  color-coded  to  non-color-coded  information  dynamical!; 
displayed  on  TV.  The  first  experiment  used  a 2 x 2 factorial  design  to  investigate  color-coded  versu 
B&W  displays  and  experienced  subjects  compared  to  naive  subjects.  For  this  experiment,  an  engim 
display  monitoring  task  contained  10  malfunctions  presented  over  a 22-minute  period.  Color-codet 
versus  B&W  displays  were  evaluated  with  a single  factoi  design  for  the  second  experiment  in  which  on!; 
3 malfunctions  were  presented  over  a 22-minute  period. 

For  the  third  study,  seven  display-color  conditions,  four  experience  levels,  and  two  colors  o 
illumination  were  investigated  with  a 7x4x2  repeated  measures  design.  Illumination,  the  repeatci 
factor,  was  counterbalanced  across  all  subjects.  Each  display  condition  was  seen  by  one  of  seven  groups 
The  groups  were  composed  of  one  subject  from  each  of  the  four  experience  levels.  In  this  experiment 
13  malfunctions  and  33  targets  were  displayed  over  each  of  two  22-minute  test  periods.  The  design  fo 
this  study  is  shown  in  Figure  3. 


FIGURE  3.  Experimental  Design. 
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SUBJECTS 

All  of  the  subjects  (Ss)  for  these  studies  were  Naval  Weapons  Center  personnel  between  the  ages 
of  22  and  43.  The  first  experiment  used  12  civilians  in  professional  occupations  who  were  divided  into 
two  groups  of  naive  and  experienced  Ss  based  on  their  prior  participation  in  target  acquisition  studies 
Six  civilian  professionals  of  varying  experience  levels  served  as  Ss  in  the  second  experiment.  In  the  third 
experiment.  28  Ss  were  assigned  to  serve  in  one  of  four  groups.  (1 ) civilian  professionals  experienced  in 
target  acquisition  studies  (termed  as  “Test-Wise"  subjects):  (2)  civilian  professionals  without  experience 
in  target  acquisition  (termed  “Naive  Civilian’’);  (3)  military  pilot  and  bombardier/navigator  officers 
experienced  in  target  acquisition  (termed  “Pilots- B/Ns”);  and  (4)  military  enlisted  men  inexperienced  in 
target  acquisition  (termed  “Naive  Military”).  All  Ss  were  tested  on  the  Bausch  and  Lomb  Armed  F orces 
Vision  Tester  and  had  20/20  or  better  visual  acuity.  Additionally,  those  Ss  who  participated  in  any  ot 
the  conditions  involving  color  had  normal  color  vision  as  determined  with  the  Dvoiine 
Pseudo-lsochromatic  Plates. 

PROCEDURE 

Each  S was  shown  the  experimental  apparatus  and  then  seated  at  a viewing  distance  of  30  inches 
(762  mm)  from  the  displays.  He  was  allowed  to  lean  forward,  if  he  wished,  but  was  not  allowed  to 
move  back  beyond  the  stated  viewing  distance.  Recorded  Instructions  (see  Appendix  A)  then  described 
the  required  task  and  explained  the  procedure.  Next  followed  4 minutes  of  practice  involving  only  the 
target  video  and  target  response  button.  If  the  S had  difficulty  in  detecting  targets,  the  video  tape  was 
replayed.  Then  4 minutes  with  just  the  engine  management  display  was  ptacticed,  followed  by  4 minutes 
of  practice  using  all  displays  and  response  buttons.  The  experiment  was  begun  when  a S could  perform 
the  last  2 minutes  of  practice  without  error.  The  experiment  proceeded  with  the  viewing  one  of  the 
prescribed  conditions.  When  the  S had  completed  this  portion  of  the  experiment,  the  video  tapes  were 
rewound  in  preparation  for  the  next  condition.  Each  portion  of  the  experiment  required  22  minutes  to 
complete  plus  a 5-minute  break  while  the  tapes  were  being  rewound.  The  total  time  required  of  a S was 
typically  70  minutes. 

ANALYSIS 

Both  target  detection  and  malfunction  detection  times  were  recorded.  Detection  time  was  defined 
as  the  interval  between  the  onset  of  a malfunction  or  the  appearance  of  a target  and  the  subject's 
response.  Misses  were  scored  as  8 seconds  and  12  seconds,  respectively,  for  targets  and  malfunctions. 
Errors  of  omission  and  commission  were  also  recorded  and  may  be  found  in  Appendix  B.  Analysis  of 
variance  was  used  to  analyze  the  response  time  data,  while  levels  within  a significant  factor  we  e 
evaluated  with  Newman-Keuls  comparison  tests.  The  t statistic  was  used  to  analyze  the  second 
experiment,  as  well  as  to  compare  the  results  between  the  first  and  second  experiments.2 3 And.  finally, 
relative  scores  were  calculated  from  the  response  time  data.  This  was  done  to  provide  a performance 
baseline  with  B&W  displays  as  a standard  of  comparison  for  performance  with  colot  and  color-coded 
displays.  Percent  performance  change  was  calculated  from  the  formula 

-2  B.  .1  Winer  Statistical  Principles  in  Experimental  Design,  2d  cd.  San  l-'rancisco,  McGraw-Hill.  1971 . 
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Rn  - Rr 

Change  (%)  = — — x 100 
RB 


where  R[j  is  the  B&W  mean  response  time  and  Re  is  the  response  time  to  a display  under  the  specified 
color  condition. 
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DISPLAY  COLORS 


Ttie  analysis  showed  that  display  color  had  a significant  effect  on  performance  for  all 
experiments.  For  Experiments  1 and  II  (one  engine  display  and  one  scenery  display  ) there  was  no 
difference  in  performance  on  the  engine  display  whether  it  was  color-coded  or  B&W.  However,  when  it 
was  color-coded,  target  detection  time  on  the  scenery  display  decreased  significantly  <p<  0.01  and 
p <0.025,  respectively,  for  Experiments  I and  II).  No  significant  difference  in  response  time  was  found 
between  the  10  malfunctions  presented  in  Experiment  I and  the  3 malfunctions  presented  in 
Experiment  II. 

The  findings  for  the  first  and  second  experiments  suggest  that  subjects  were  more  attentive  to  the 
scenery  display  when  the  engine  display  was  color-coded  than  when  it  was  not.  Additionally,  the 
extremely  low  error  rate  (<  2%  missed  targets)  suggests  that  Ss  had  little  difficulty  with  the  task  in 
either  color  or  B&W. 

The  analysis  of  Experiment  III  (one  scenery  display  and  two  engine  displays)  showed  that  the 
display  color  affected  performance  on  both  the  target  display  and  the  color  engine  display  (p<0  001), 
but  not  on  the  second  B&W  engine  display.  Figured  shows  how  each  of  the  display  colors  compared  to 
B&W  TV  in  terms  of  percent  performance  change  relative  to  response  time.  The  mean  response  time 
(3.33  sec)  when  all  three  displays  were  shown  in  B&W  TV  provides  the  performance  baseline  (O'7?). 

It  can  be  seen  that  monochromatic  yellow,  blue,  and  color-coded  red-on-white  provided  an  overall 
higher  performance  level  than  did  B&W  TV.  On  the  other  hand,  monochromatic  red  and  green  degraded 
performance  while  color-coded  red-on-yellow  was  comparable  to  performance  with  B&W  TV. 


FIGURE  6.  Color  Relative  to  Achromatic  TV  Mean  Response  Time 
Performance  for  Each  of  Three  Displays. 

•The  performance  baseline  in  this  f-gure  (0%)  is  th  ‘eon  response  time  found  foi  the*  experiment 
when  all  displays  were  shown  in  B&W. 


These  experiments  have  shown  (l)that  a color-coded  TV  engine  display,  compared  10  a B&W  TV 
engine  display,  offers  some  improvement  in  ^ . erall  response  time  performance,  and  (2)  that 
monochromatic  colors  on  TV  differentially  affect  performance.  The  rather  weak  performance 
improvement  provided  by  color-coding  may  be  due  to  the  apparent  easiness  of  the  task.  Error  (omission) 
rates  continued  at  less  than  2%  even  when  the  third  display  was  added  for  the  final  experiment.  This 
suggests  that  ample  time  was  available  for  subjects  to  accomplish  the  task  and  that  their 
information-handling  capacity  was  not  taxed.  There  is  some  evidence  to  support  the  view  that 
color-coding  becomes  more  effective  with  increasing  work  loads.23  Although  it  was  believed  the  addition 
of  a second  engine  display  for  Experiment  111  would  test  this  view,  clearly  it  did  not.  Also,  there  is  the 
view  suggesting  that,  with  extensive  practice,  the  initial  benefits  of  one  coding  method  over  another, 
including  color-coding,  tend  to  become  minimal.3  Research  is  needed  to  simultaneously  test  both  views. 


DISPLAY  ILLUMINATION 


The  displays  for  the  third  experiment  were  illuminated  with  low  levels  (4.3  lux)  of  either  red  or 
white  light.  The  color  of  the  ambient  illumination  did  not  have  a significant  main  effect  on 
performance.  However,  illumination  interacted  with  experience  to  affect  performance  on  the  color 
engine  display  (p  < 0.005).  Figure  7 depicts  this  significant  interaction.  It  shows  that  both  naive  subject 
groups  performed  better  under  white  light,  pilots-B/Ns  performed  better  under  red  light,  and  the  lighting 
made  little  difference  to  the  Test-Wise  group.  Since  performance  was  relatively  poor  for  the 
monochromatic  red  condition,  scores  for  this  display  color  were  checked  against  both  red  and  white 
illumination.  There  was  no  difference.  The  performance  of  subjects  using  the  red  display  was  relatively 
poor  under  both  red  and  white  illumination. 

4.0^- 

• TEST-WISE 

— O PILOTS-B/Ns 

3.8  — A NAIVE  CIVILIAN 

A NAIVE  MILITARY 


3 6 


3.4 1— 


5 3.2f— 


3.0 


28 


FIGURE  7.  Illumination  by  Experience 
Interaction  for  Color  Engine  Display. 
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Honeywell,  Inc.  “Color  C oding  Research.”  by  Majoric  J Krebs.  Minneapolis,  Minn.,  1976  (Unpublished  paper  ) 
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Within  the  limits  investigated,  the  experiment  indicates  that  illumination  color  does  not  inherently 
affect  the  performance  of  detection  or  monitoring  casks  on  television.  However,  the  illumination  by 
experience  interaction  suggests  that,  with  color  displays,  people  used  to  working  under  one  light  color 
need  some  amount  of  additional  practice  to  work  as  effectively  under  the  other  light  color. 


OBSERVER  EXPERIENCE 

Civilian  subjects  experienced  in  target  acquisition  tasks  were  compared  with  civilian  subjects 
inexperienced  with  target  acquisition  tasks  in  the  first  experiment.  No  significant  differences  in 
performance  were  found  between  the  two  groups.  Experience  level  was  again  investigated  in  the  third 
experiment.  Here,  experience  was  split  into  two  groups:  (1)  civilian  (Test-Wise)  and  (2)  military 
(pilots-B/Ns).  Inexperience  was  also  split  into  two  groups:  (1)  civilian  (naive)  and  (2)  military  (naive).  No 
difference  in  malfunction  detection  performance  on  the  engine  displays  was  found  between  the  four 
groups.  However,  experience  was  found  to  affect  target-detection  performance  (p  < 0.001).  Application 
of  the  Newman-Keuls  test  to  the  experience  factor  shows  that  the  performance  of  the  naive  military 
group  was  significantly  different  from  the  performance  of  the  other  three  groups. 


Inspection  of  the  data  indicates  that,  when  the  naive  military  group  saw  the  targets,  they  had 
response  times  similar  to  the  other  three  groups,  but  they  missed  three  times  as  many  targets.  This 
suggests  that,  with  additional  practice  on  a target-detection  task,  this  group  would  perform  on  a level 
comparable  to  the  other  three  groups. 


SUMMARY 

The  results  from  these  three  experiments  investigating  color-coding  on  television  displays  are 
summarized  as  follows: 

1.  Target  detection  response  time  on  the  scenery  display  was  faster  when  the  engine  display 
was  color-coded  than  when  it  was  not. 

2.  Color-coding  on  one  engine  display  did  not  affect  performance  on  an  adjacent  B&W  engine 
display  of  identical  format. 

3.  Response  time  performance  with  yellow  or  blue  monochrome  engine  displays  w:is  not 
significantly  different  than  with  color -coded  displays,  while  performance  with  red  or  green  monochrome 
displays  was  significantly  slower  than  with  color-coded  displays. 

4.  Performance  with  the  various  display  colors  was  not  affected  by  the  color  (red  or  white)  of 
the  ambient  illumination. 

5.  Experience  level  was  not  an  important  factor  for  these  experiments. 

6.  Too  few  errors  were  made  on  both  color  and  BA W displays  (<2r>-)  to  adequately  test  the 
percent  correct  performance  measure. 

7.  The  statistically  significant  improvement  in  response  time  performance  with  some  coin- 
displays  is  not  necessarily  significant  in  an  operational  sense.  Additional  studies  employing  a w dot  \in; 
of  workloads  and  training  arc  recommended  and  required  to  validate  this  point. 
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Appendix  A 

SUBJECTS’  RECORDED  INSTRUCTIONS 

The  purpose  of  this  experiment  is  to  help  us  determine  how  well  people  perform  two  tasks  under 
varying  conditions.  Your  primary  task  is  to  detect  vehicular  targets  a pair  of  tanks  or  trucks  -like  these 
on  the  upper  TV.  (E  shows  tandem  arrangement  of  target-pair).  When  you  see  targets,  push  this  button 
(E  provides  hand-held  response  button).  If  the  targets  appear  in  Sector  One,  push  the  button  once;  if 
they  appear  in  Sector  Two,  push  it  twice,  and  if  in  Sector  Three,  push  it  three  times. 

Your  secondary  task  is  to  monitor  these  indicators  on  the  bottom  two  TV  screens.  Whenever  one 
of  these  pointers  exceeds  the  tolerance  limits  shown  by  these  markers,  in  either  direction,  push  the  left 
or  right  button  corresponding  with  the  left  or  right  TV,  and  then  push  the  button  corresponding  with 
the  out-of-tolerance  indicator.  If,  at  any  time,  you  make  an  error,  simply  call  out,  “ERROR",  then 
make  the  correct  response  and  continue  with  the  task. 

Now  there  will  be  several  minutes  of  practice.  First,  you  will  see  about  4 minutes  of  scenery  with 
the  targets  on  the  upper  monitor. 

For  this  part  of  the  practice,  you  will  hear  a tone  indicating  that  a target  is  present.  Practice  your 
response.  Ignore  the  lower  TVs  for  the  moment.  Ready?  (£  runs  for  4 minutes  of  scenery  video  tape, 
checking  the  subject's  responses).  Now  you  will  see  4 minutes  of  tape  containing  malfunction  indications 
on  the  lower  monitors.  Again,  practice  your  responses.  Ignore  the  top  monitor  for  the  moment.  Ready? 
(£  runs  4 minutes  of  video  tape  containing  malfunction  indications  and  checks  the  subject's  responses). 

During  the  last  part  of  the  practice,  all  three  TVs  will  be  operating.  Fot  the  first  portion,  a short 
beep  will  sound  when  a target  is  in  the  middle  of  the  screen.  There  will  be  no  tones  the  last  2 minutes 
of  practice.  Remember  to  watch  all  three  screens,  and  make  the  proper  responses.  Ready?  (L  plays  the 
next  4 minutes  of  the  video  tapes,  observing  the  subject's  responses.  If  any  errors  are  made  during  the 
last  2 minutes  of  practice,  the  tapes  arc  rerun  until  no  errors  occur  during  the  final  2 minutes.) 

There  will  be  no  more  tones.  This  portion  of  the  experiment  will  last  about  22  minutes.  There 
will  be  a short  break,  and  then  we'll  complele  the  last  22  minutes.  We  are  ready  to  begin.  Are  there  any 
questions? 
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Appendix  B 
ERRORS 


Three  types  of  errors  were  committed  during  these  experiments:  (1)  momentary  (M)-S  realized 
his  mistake  and  self-corrected;  (2)  commission  (C)-S  reported  targets  that  were  not,  in  fact,  real  targets, 
or  responded  incorrectly;  and  (3) omission  (O)— S did  not  respond  to  targets  that  were,  in  fact,  present. 
The  errors  are  noted  by  each  experiment  below.  No  further  attempt  was  made  to  analyze  the  errors  due 
to  the  paucity  of  data. 


Experiment 


Error 


(C) 

(O) 


False  targets 
Missed  targets 


fC) 

(O) 


False  targets 
Missed  targets 


(C)  False  targets 
(O)  Missed  targets 
(O)  Missed  malfunction 
(C)  Pushed  wrong  button 
(M)  Pushed  wrong  button 


Experimental  conditions 


Color-coded 


Experienced 


Test-Wise  [ Pilots-B/Ns 


B&W 


Naive 


Civilians 
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SMUPA-AD-C  (1) 

SMUPA-FRL-P  (1) 

1 Army  Ballistics  Research  Laboratories,  Aberdeen  Proving  Ground 

2 Army  Human  Engineering  Laboratory,  Aberdeen  Proving  Ground 

2 Army  Materiel  Systems  Analysis  Agency,  Aberdeen  Proving  Ground 
1 Army  Mobility  Equipment  Research  and  Development  Center,  Fort  Belvoir  (Library) 

1 Army  Research  Institute,  Arlington 

1 Fort  Huachuca  Headquarters,  Fort  Huachuca 

2 Frankford  Arsenal 

1 Redstone  Arsenal  (DRXHE-MI) 

1 White  Sands  Missile  Range 

1 Air  Force  Logistics  Command,  Wright-Platterson  Air  Force  Base 
1 Air  Force  Systems  Command,  Andrews  Air  Force  Base  (SDW,  Roger  Hartmeyer) 

1 Tactical  Air  Command,  Langley  Air  Force  Base 
1 Oklahoma  City  Air  Materiel  Area,  Tinker  Air  Force  Base 
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3 Aeronautical  Systems  Division,  Wright -Patterson  Air  Force  Base 
Code  AERR  (1) 

Code  RW  (1) 

Code  XR  (1) 

1  Aerospace  Medical  Research  Laboratory,  Wright-Patterson  Air  Force  Base  (Code  HEA) 

1 Air  Force  Armament  Laboratory,  Eglin  Air  Force  Base  (Technical  Library) 

12  Defense  Documentation  Center 

2 Director  of  Defense  Research  & Engineering 

TST&E  (1) 

DAD/E&LS  (1) 

1 Defense  Intelligence  Agency 

1 Applied  Physics  Laboratory,  JHU,  Laurel,  MD 

2 Autonetics/Rockwell  International  Corporation,  Anaheim,  CA 
(Human  Factors  Group) 

2 Calspan  Corporation,  Buffalo,  NY  (Life  Sciences  Avionics  Dept.) 

2 General  Research  Corporation,  Santa  Barbara,  CA 

3 Hughes  Aircraft  Company,  Culver  City,  CA  (Display  Systems  Laboratory) 

1 Human  Factors  Research,  Incorporated,  Goleta,  CA 

1 Institute  for  Defense  Analyses,  Arlington,  VA  (Technical  Library) 

2 McDonnell  Douglas  Corporation,  Long  Beach,  CA  (Director,  Scientific  Research. 

R&D  Aircraft  Division) 

2 McDonnell  Douglas  Corporation,  St.  Louis,  MO  (Engineering  Psychology) 

1 Martin-Marietta  Corporation,  Orlando,  FL 

1 National  Academy  of  Sciences,  Vision  Committee,  Washington,  D.C. 

1 Rockwell  International  Corporation,  Columbus,  OH 

2 Systems  and  Research  Center,  Minneapolis,  MN  (Vision  & Training  Technology) 

5 The  Boeing  Company,  Seattle,  WA  (Crew  Systems  MS-41-44) 

1 The  Rand  Corporation,  Santa  Monica,  CA  (Dt.  H.  H.  Bailey) 

1 University  of  California,  Scripps  Visibility  Laboratory,  San  Diego,  CA 

2 Virginia  Polytechnic  Institute,  Blacksburg,  VA  (Industrial  Engineering  Department) 

2 Vought,  Incorporated,  Systems  Division,  Dallas,  TX  (Human  Factors  Engineering) 
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